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• ■ ABSTRACT 

The HF channel is characterized with regard to frequency 

selective fading and atmospheric noise under restrictive 

mathematical assumptions, and compared with measured 

statistics. Actual channel characteristics are utilized to 

obtain parameters for choosing appropriate convolutional 

codes. Short threshold decodable convolutional codes with 

only a moderate amount of interleaving are shown to be 

capable of affecting a reduction in the output error 

probability by at least an order of magnitude, for uncoded 

_2 

error probabilities on the order of 2 x 10 
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HF 


- Frequency portion of the radio spectrum from 3 to 
30 MHz 


MUP 


- Maximum usable frequency 
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- Lowest useful high frequency 


f(x) 


- Probability density function of the continuous 
random variable x 


E[g(x)] • 


- Operation of taking the expected value of g(x) 


C(C) 


- Expected value of where j = -1 


J 


- Jacobian - coordinate transformation from (u,v) 
to (x,y) 


J„(x) 


- Bessel function of order n 
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- Average probability of an error In digital system 




- Signal duration 
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- Variance of zero mean Gaussian noise 
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- Probability that the envelope of received atmos- 
pheric noise exceeds V^ 
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- Amplitude probability distribution 
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received channel digits 
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I . INTRODUCTION 



Radio communication in the frequency range from 2-30 MHz 
has been common for many years. However, the reliability of 
such a channel is not high enough for modern high speed 
computer to computer communications. In order to Increase 
the reliability of this form of communications, the nature 
of the channel must be understood, or at least modeled in 
a fashion that is a reasonable approximation to the situa- 
tion. Once this is accomplished, various solutions may be 
attempted to obtain optimal reliability via the channel. 

To describe the situation in general terms, the trans- 
mitter sends a signal through the channel to a receiver. 
However, due to various causes, the signal received may not 
be the one sent, in which case an error is said to have 
occurred. These errors result from two basically different 
causes: 1) signal distortion, and 2) noise. Noise is 

considered throughout this report to be completely unrelated 
to the signal, while signal distortion is considered as a 
perturbation of the signal and thus is related to the 
signal. As an example, if a portion of the signal energy 
is delayed so that it arrives slightly later than the rest 
of the signal. Interference will result. If the interference 
is destructive, the total received signal will be less and 
the signal is said to fade. 

The first section is devoted to a detailed discussion 
of the signal and one common form of noise associated with 



the channel. The second section discusses convolutional 
codes In general and applies them to the channel as charac- 
terized In the first section. It Is shown that It Is 
possible to obtain several orders of magnitude Improvement 
In the probability of not making an error. 



Jl 



II. THE SIGNAL ENVIRONMENT 



A. INTRODUCTION 

The HP channel is difficult to analyze in general due 
to the number and complexity of the various parameters. 

The channel is time varying over a period of hours, days, 
months, or years. (The eleven year sun spot cycle greatly 
effects parameters such as Maximum Usable Frequency (MUP), 
Lowest Useful Frequency (LUF) and absorption.) In general 
the HP communication channel is not normally line of sight , 
this implies that there is some form of 'bending' involved 
with the path of propagation of the electromagnetic radia- 
tion. This 'bending' results from two principal sources: 

1) refraction caused by a gradient in the dielectric 
constant of the medium, and 2) reflection caused by an 
abrupt discontinuity in the dielectric constant. Refraction 
normally accounts for a considerable amount of the signal 
energy received and, is commonly referred to as the specular 
component . 

In the way of a basic review, the upper atmosphere 
becomes ionized in various regions from ultraviolet and cor- 
puscular radiation from the sun [1]. Incident electro- 
magnetic radiation is refracted by these levels and if the 
operating or carrier frequency is properly chosen the 
radiated signal will return to earth at the receiver. The 
amount of energy received is dependent on many factors 
ranging from antenna polarization to angle of launch or 






reception and the exact state of the ionlsphere. Frequently 
multiple paths will be possible and the resulting signals 
at the receiver may add either constructively or destruc- 
tively. In addition to the refraction, some of the Incident 
radiation may be scattered from irregularities in the ionls- 
phere and this will also be received. Figures 2.1 and 2.2 
Illustrate the basic phenomena. Hence the received signal 
is the sum of the scatter and spectral signals. The 
probability characteristics of this type of signal have been 
well treated by Nesenbergs [2] and are Included here only 
for a review. 




specular components at the receiver. The 
refraction of the incident electromagnetic 
energy is a result of the gradient of ion 
density as a function of height. 



1^1 



I 




In the Ionosphere. The discontinuities 
may be due to numerous causes such as 
meteor trails or turbulance. 



For a given path length, a relatively straight forward 
computational procedure may be followed to give the maximum 
usable frequency, and the relative amplitude of other 
specular components which may be presented v;lth the fraction 
of time these components may be expected. Hence, for a given 
operating frequency, a rough approximation may be made v;ith 
regard to the number of specular components. This, we shall 
see, will affect the bit error probability. Table I is a 
set of sample predictions (from Ref. 2) Indicating the 
specular components probable together with the percentage 
of times they were expected to be present. 

It is apparent that this system is quite complicated, 
so let us begin by making some restrictive assumptions which 
will facilitate the mathematics. 
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We assume that the HP channel under consideration is 



stationary. While this Is not strictly true, over the 
period of several minutes it is a very reasonable approxi- 
mation. A second helpful assumption is that all the 
components (scatter and specular) are mutually statistically 
independent. This assumption will permit us to use char- 
acteristic functions and simplify our task. (The number of 
modes possible may be determined by the relationship of the 
carrier frequency with the maximum usable frequency, however 
if the modes exist their effects may be statistically 
independent . ) 

It will also be assumed in this section that the environ 
mental noise is gaussian. In a later section we will con- 
sider in some detail a recent, model for atmospheric noise 
and indicate the modifications which result. 

B. SIGNAL AMPLITUDE CHARACTERISTICS 

We begin by considering the received signal as two 
dimensional, where the two dimensions will be the Inphase 
and quadrature components of the signal. We will have 
occasion to consider two basic types of signals which may 
be present at the same time, hence we define a signal to 
be specular if it is of fixed amplitude, although the phase 
may still be random. A second type of signal, called 
scatter , is characterized by a symmetric bivariate gaussian 
distribution which for mathematical convenience has equal 
inphase and quadrature variance. We define the probability 
distribution function (DP) of the random variable X as 



1 n 



F(x) = Prob (X < x) 



^OO < X < ^ 



with the corresponding probability density function (pdf) 



f(x) 



dF(x) 

dx 



It will be convenient to define. In the standard fashion, 
the characteristic function 



C(C) = E[e^^^] 

CO . w 

= / e-^^^ dF(x) 

~00 



= / 



J' Cx 



f (x)dx 



— CO 



where E[*] denotes the expected value. 

For our purpose, we consider the two dimensional case where 
F(x,y) = Prob(X < x, Y £ y) 

with the corresponding joint probability density function 
f(x,y) and characteristic function 

C(C,n) = / f (x,y)dxdy . (1) 



Let us consider a typical specular component, 

.^1 

V. = X. + jY. = Iv. 1 e^ 

1 1 *^1 ' 1 ' 



where X^ Is the cosine component, Y^^ the sine component, 
|V^| is the envelope and 4> the phase of . Let us assume 
that the phase Is uniformly distributed over (0,2tt), and 
independent of |V^|. Since we are dealing with a specular 
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component, which, by definition, has a constant amplitude, 
we have 




where x. and y. are the Inphase and quadrature components 
J ^ 




respectively and r^ 




and since lV^| and (})^ are Independent 

We desire the pdf of , which may be expressed as 

//f|„l .(p,<}>) dpd(}) = // f„ (x,y) dxdy 

V$ ' ' XY '^i 

Changing variables to x = pcos<}), y = psincfi, we have the 
Jacobian 





so we now have 



f'hri a(P)'P) dpd(p = // pf,, (pcoscf), pslncj)) dpdcj) 
p$ p$ ^1 



from whence 



f I V| ,(j)(P,‘^) " pfy_ (pcos<j), psincj)) 



= pfy^ (x,y) 



1 




and 



f|v| j 



( 2 ) 



From equation 1 we may write the characteristic function 
for the specular component as 



C.(C,n) = / / 

^00 ^00 



,J< 5 x+r,y) 5(/^2„2 _ri) 



dxdy 



/;-2.-2 



2tt / X +y 



Again letting x = pcoscj), y = psin((); the Jacobian is again 
p and 



C^(C,n) 



00 jp(Ccos4>+nsln()))g/' p. ') 

/ / ^ -Ipldpdcj) 

0 0 2ttp 



The exponent may be reduced by noting: 



Ccoscf) + nsincf) 



= 



I / 



cos(t>■^ 



/'2^ 2 
/ ^ +T] 



sinct)] 



whe 



= y'^2_|_^2 cos((j)-i-a) 

= C COS(})* 

re C = y^2^^2 and (|) ' is again uniform on (0j2tt), hence. 



C. (?,n) = C. (c) = / <S(p-r. ) * ^ / d())’dp 

1 1 0 0 



From Reference 3 , item 9.1.21 



/ . \ ’“in 7T • ^ 

T / \ ( J ) f J XCOS 6 ( c \ ^ Cl 

J (x) = / e^ cos(n0)d0 

n tt „ 



hence 



C.(C) = / 6(TT-r. ) J_(CP)dp 

1 Q 1 o 



( 3 ) 






2 2 



where C = . 



Turning our attention to one of the scatter components, 
which is characterized by the bivariate gaussian distribu- 
tion, we have the pdf: 



fg (x,y) 
1 



2 

X 



/ 



27ra . 
1 




2 

/2 



1 





where again p = y^2^^2 . 

From Reference 3j item 26.1.26 the characteristic function 
is 






Cg (c) = e 
1 



where again Z, = y^^2_^^2 



(5) 



We now define the scatter vector to be the sum of all 
the Independent scatter components. Our motive for proced- 
Ing to the characteristic functions becomes clear since the 
characteristic function of a sum of Independent random 
vectors is simply the product of their characteristic func- 
tions. Hence, we have for the characteristic function of 
the scatter component: 



n 

Cc.(C) = n e 
^ 1=1 



— r~ 



= e 



2 

C E a. 

X 1=1 - 



( 6 ) 



= e 



2 2 
a C 

~r~ 



2 ^2 

where o = E cr, . The characteristic function of this 
1=1 ^ 

scatter vector and one specular component Is then 



C(C) = Cg(c) C^(C) 



2.2 

o C 

= e 



By adding a total of n specular components the character- 
istic function becomes; 



C(C) 



2.2 

o K 



n 

n 

1=1 






( 7 ) 



The characteristic function j as we have developed It here. 
Is convenient for expressing only the even moments since 



12 \ rn 

E[p2”l = i IjJ 0(C) 

The second moment (m = 1) Is: 

2 2 2 
E[p ] = + E r. 

1=1 
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The pdf for |V| may be expressed in terms of the Humbert 
hypergeometrlc series (see Ref. 2): 




2 

n . _ £i _ IlL 

-^3 ns n 



3 2 ’ 2 ’ ' ' * 

a a 



r. 



n 



2 



2 



( 8 ) 



a 



Let us now restrict ourselves to digital systems where 
we may relate the signal pdf above, to the probability of 
an error We define the probability of an error as the 

expected value, averaged over the distribution of the 
signal amplitude, of a "probability of error function." 

In other words 



The ’probability of error function' is determined by the 
modulation/detection procedure and the noise environment. 

It represents the probability of making an error at a par- 
ticular time as a function of the signal amplitude and a 
given type of noise. Equivalently, it may be vlev;ed as 
either the probability of a false alarm or the probability 
of a miss in detection theory. V/e consider only the case 
of noncoherent frequency-shift-keying in stationary, zero 
mean, gaussian noise. If the signal duration is T^ , the 
receiver bandwidth B, and the total noise power is the 
receiver pass band is N^, then the probability of making an 
error for a given signal amplitude is given by Montgomery 
t^] as ; 



3 = E[p^(p)] 



(9) 



oo 



/ Pg(p) f|y|(p)dp 



0 



2 5 










4 




( 10 ) 



T Bp2 

Pg(p) =^'5 6 ^ 

We note, in passing, that in case of constant signal energy 
where p = v^, our definition of the probability of an error 
is consistent; since in this case, 

f^(p) = 6(p - /E) 

and 



TgBp' 

2N^ 



3 = 



/ 

0 



6(p - /E) 



dp 



TgBE 

2N^ 






which is the well known result, giving the bit error prob- 
ability as a function of signal energy/noise energy . 

With the signal duration, T , receiver bandwidth, B, 
and noise power N^, we may utilize equations 9 and 10 
together with the envelope pdf given in equation 8 to 
obtain the probability of an error. The result, from 
Nesenbergs [Ref. 2] , is 
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where r^ = amplitude of the i^^ specular component and 

variance of the scatter components of the received signal. 
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Nesenbergs has developed bounds for this hypergeometrlc 
series in Reference 2 which yield: 



calculated by Nesenbergs" in Ref. 2. 

It can be seen from Table I that as the frequency is 
decreased below the MUP, other propagation paths may occur, 
resulting in the bit error probability as described in 
Equation 11. While for frequencies well below the MUF, the 
signal amplitude pdf may be very nearly Rayleigh, for 
frequencies near the MUF the Rayleigh approximation is not 
appropriate. One could reasonably expect the ratio of the 
operating frequency to the MUF will be roughly related to 
the bit error probability. Increasing the ratio toward 
unity results in fewer modes with a corresponding decrease 
in the error probability, while a decrease in the ratio 
Indicates the possible existance of more modes causing an 
Increase in the error probability. This effect is experienced 
during periods of the day, such as sunrise or sunset, when 
the MUF is changing rapidly, and the carrier frequency is 
fixed. Tsai [5] and McManamon [6] have also noted this 
effect in more quantitative terms. 




2 2 

where r = Z r^ . Figure 2.3 Is a plot of some special cases 
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Figure 2.3. Bit error probability 3 as a function 
of signal to noise ratio (db). (Reprinted 
from Ref. 2, p. 82, with permission.) 
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There are, of course, other sources of error in the HP 
channel. One such source, which may have an appreciable 
effect on the error probability, is atmospheric noise. The 
next section deals with this noise in some detail. 

C. ATMOSPHERIC NOISE 
I . Introduction 

Atmospheric noise is the name generally associated 
with electromagnetic energy which has its source in natural 
phenomena such as lightning discharges. In general, atmos- 
pheric noise is impulsive and nonstationary. Geographically, 
the largest dynamic range occurs v/ithin the tropics, from 
whence it propagates into the northern and southern hemis- 
pheres. For any particular location the received rms or 
average power will be determined by local thunderstorm 
activity, as well as the propagation conditions to 
the tropics. Although the largest dynamic range (on the 
order of 100 db) occurs in the lower portion of the frequency 
spectrum (ELF-LP), it may be the limiting type of noise 
within a major portion of the HF spectrum. Statistical 
parameters such as average power, and average envelope 
voltage have been measured quite accurately and the results 
published in the form of Technical Notes by the National 
Bureau of Standards, and the International Radio Consulta- 
tive Committee (CCIR Report 322, "V/orld Distribution and 
Characteristics of Atmospheric Radio Noise" [7] )• 



Numerous models for atmospheric noise are contained In 
the current literature [Refs. 8 and 91 . Most of these model 
are based on an Impulse model with the Impulses distributed 
according to some particular rule. Models such as these 
have two principal difficulties, first the parameters of 
the distribution are chosen so they match the first order 
statistics of the received noise and have very little 
correlation with statistics such as pulse Interval distri- 
bution or pulse duration distribution. Secondly, there 
may be serious computational difficulties. A more recent 
model was proposed by H. M. Hall [Ref. 10]. The Hall model 
seems to fit the measured statistics of the noise and hence 
will be used for the remainder of this section. 

2. The Hall Model 

The noise y(t) Is considered to be the product of a 
zero mean narrow bandpass gausslan process n(t) with a 
covariance function R^(x), and a slowly varying regime pro- 
cess A(t) which Is assumed to be Independent of n(t) and 
stationary. Although the actual atmospheric noise Is non- 
statlonary. It may be approximated by a stationary process 
for a reasonably short period of time. The statistics of 
the modulating regime process are chosen so the resulting 
product y(t) = A(t) • n(t). Is an accurate description of 
the received noise. 

Summarizing Hall's treatment v;e have the following pdf 



for the regime process 



- 6 < a < { (12) 
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(a chi distribution with parameters m and a), where k is 
chosen so that 
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/ f^(a)da = 1 

a. 



(13) 



The use of a finite limit for the amplitude Is based on the 
required convergence of the Integral for 1 ^ m £ 2, since 
the energy radiated must be finite, and to match the observed 
levels at the higher frequencies in the HP band. 

The gausslan component Is 
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The calculation of the pdf for y(t) Is straight forward 
[Ref. 11] 



f(y)=/ p(x)P ^ T~T 
y _oo ^ ^ 1^1 



(15) 



Substituting equations 13 and 4l into 15 results in 



fy(y) 
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Noting that the Integrand is an even function and making the 
substitution K = f (y) becomes 
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or equivalently 
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If we consider the case where 6 ->■ «>, then 




and equation I 6 reduces to 




In order to compare this mathematical model with the 
measured atmospheric noise we must find the complement of 
the probability distribution function for the envelope and 
phase. We let 

y(t) = V(t)Cos(m^t + 4>). 

The pdf of the envelope and phase may then be obtained in 
terms of the inphase and quadrature components of the 
received noise as 
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// f (V,(}.)d4)dV = // f ~(y,y)dydy 
V4> YY 

where f ~(yjy) is the joint pdf of the inphase (y) and 

y y y 

quadrature (y) component of the received noise. Changing 
variables on the right hand side of the equality sign to 
y = VCostJ), y = VSincj), yields the Jacobian, J = V(Cos <}> + 
Sin^cj)) = V and 

// f . (V,4))d(()dV = // V f ~(V cos(J), V sin(|)) dVdcf) 

V$ V$ ^ 

hence 



f = V f ~(V cos(t>, V sintf)) 

r,cf)" y,y ’ 

We let n(t) represent the quadrature component of the narrow 
band gaussian noise and y(t) = A(t)n(t) and y(t) = A(t)n(t) 
where = N[0,R^(0)], and n(t) is independent 

of n(t). We may now express the joint pdf as: 



fy^j(y.y) = ! f^Cx) f„(|) f-{|) ^dx 
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If again we let 6 ^ then 



where 
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The complement of the desired distribution function Is simply 
the probability that the noise envelope voltage exceeds some 
threshold, Vq, l.e. 



P(V >Vq) 



00 
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P^(V)dV 
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For convenience we define 



P(Vq) = P(V > Vq) 

( 20 ) 

Figure 2.4 Is a plot of the envelope level (In db above y) 
vs. -log^Qlln P(Vq)| for various values of m. Figure 2.5 
and 2.6 are plots of actual measured atmospheric noise at 




db above 




Figure 2.4. APD's obtained from the Hall model 
for various values of m 
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Figure 2.5. APD of atmospheric noise measured at Laramie, 
Wyo. 2350-2358 MST 16PEB 1970, at a frequency of 2.5 
MHz, A Indicates measured values, the dashed line 
Is obtained from the Hall model with m = 3. 
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e 2.6. APD of atmospheric noise measured at Laramie, 
Wyo. 2335-2343 MST 17 FEB 1970, at a frequency of 
5.0 MHz. A indicates measured values, the dashed 
line is obtained from the Hall model vfith m = 4 . 



A plot 



frequencies of 2.5 MHz and 5.0 MHz respectively, 
of the form of figure Is an amplitude probability distribu- 
tion (APD) and represents the percentage of time a given 
level Is exceeded as a function of the level. The plotting 
paper Is designed so that thermal, or gausslan noise plots 
as a straight line with slope -h. Montgomery, In 1953 j t^] 
showed that, for FM or FSK modulation systems, the probabil- 
ity of a bit error Is one half the probability that the 
noise amplitude exceeds the signal amplitude. Hence If the 
slgnal-to-nolse ratio Is 10 db , one has simply to find the 
percentage of time the level corresponding to 10 db above the 
rms noise level Is exceeded. This percentage will then be 
twice the bit error probability. As an aside, an approximation 
to the APD may be Inferred from the data In CCIR Report 322 [71. 

As In the case of the signal amplitude, we have only 
obtained an ’average’ bit error probability. There Is no 
indication of the" correlation betv/een errors. Present 
research (Spaulding, Disney, and Espeland [12]) Indicates 
that the burst interval distribution and burst duration 
distribution may be matched as closely as desired by proper 
specification of the covariance function for the modulating 
regime process A(t). V/hlle this is an Important factor. It 
Is not within the Intent of the present paper, so v;e will 
simply give some typical cases to indicate the character- 
istics of the burst parameters. Figures 2.7 and 2.8 are 

*The data presented here vjas obtained at Laramie , Wyoming 
during the period l6-l8 Feb., 1970 while the author was In 
guest vjorker status vjlth the Environmental Science Services 
Administration . 
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Figure 2.7. Pulse Duration Distribution of Measured 
atmospheric noise. Recorded on 4 April 1969 
between 0000 and OMOO MST at Boulder, Colorado 
at frequency 5 MHz. 
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Figure 2.8. Pulse Interval distribution of atmospheric 
noise. Recorded on 4 April, 1969 between 0000 and 
0400 MST at Boulder, Colorado on a frequency of 
5 MHz. 



plots of the pulse duration distribution and pulse interval 
distribution respectively, for atmospheric noise at 5.0 MHz. 
For completeness, the APD for this set of samples is also 
plotted as Figure 2.9. 

Since the median signal energy to noise energy ratio is 
nominally greater than 20 db for the HP channel, we will 
use this figure to obtain estimates of the effect of the 
atmospheric noise on the channel. It may be seen from 
Figure 2.9 that a 20 db signal to noise ratio v/111 corres- 
pond roughly to a bit error probability approximately 
-5 

5x10 while Figure 2.7 indicates that for the pulse 
duration distribution only 1 % of the pulses were greater 
than .6 msec in duration. (The 20 db signal to noise ratio 
corresponds to level 5.) A similar analysis of Figure 2.8 
indicates that 55^ of the intervals betv;een bursts were 
longer than 60 msec. For many HP circuits, particularaly 
where a large signal to noise ratio exists, the atmospheric 
noise introduces essentially random errors. 

D. MODELING THE HP CHANNEL 

The preceding sections developed a relation between the 
bit error probabilities and the number of multipaths in 
exist ance between the transmitter and receiver. The behavior 
observed is not new or unexpected; it has long been known 
that as few as six equal amplitude signals of random phase 
may be summed to give a distribution which is nearly Rayleigh. 
We must, however, bear in mind the assumptions utilized to 
arrive at the results obtained: recall that we assumed 
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Figure 2.9. APD of atmospheric noise measured at Boulder, 
Colorado 0000- Qi^OO'MST, April 1969, at a fre- 
quency of 5.0 MHz. 
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stationary and statistically Independent specular and 
scatter components. It should be mentioned that some of 
the multipath conditions may result from magneto-ionic 
splitting and may be correlated. In addition we did not 
discuss the time delay (which may be as much as several 
milliseconds) nor the frequency distortion or doppler. In 
general we are dealing with a channel where there is corre- 
lation between errors, and even groups of errors. In 
graphical terms the bit error probability may be expressed 
as a function of time as in Fig. 2.10. Time periods, when the error 
probability is relatively high, could well result from the 
exlstance of multiple propagation paths, while the periods 
of small error probability are most likely due to little or 
no multipath and only atmospheric noise corrupting the signal. 




Figure 2,10, Error Probability as a Function of Time. 
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Another factor which limits the use of the channel is 



the differential time delay incurred by the signal traveling 
different paths. This time delay places a lower limit on 
the signal duration (for pulsed systems) since, if the 
signal duration is about equal to the time delay over one 
of the propagation paths, it will be received during the 
subsequent signal time frame. This differential time delay 
is on the order of 5 msec and hence a lower limit on the 
signal duration is between 5 and 10 msec. To make more 
efficient use of the allocated channel bandwidth, the normal 
procedure is to frequency multiplex several channels onto a 
common carrier and utilize a signal duration of about 10 msec 
on each of the sub-channels. Again propagation anomlllties 
such as the doppler shift may cause 'cross talk' between 
adjacent channels. This, in many Instances, results in 
frequency selective fading where the fading is confined to 
a small section oT the transmitted bandwidth. 

In order to describe the channel in qualitative terms 
we need to know how the errors occur. The simple bit error 
probability is not sufficient. 

If the message is to be transmitted as binary digits 
suitably modulating a radio frequency carrier, then a burst 
of length M is defined as a sequence of N digits beginning 
with a bit in error that is Immediately preceded by a correct 
bit, and ending with an error which is followed by a correct 
bit. The burst Interval is defined as the interval between 
bursts. It begins with the first correct digit following a 



burst and ends with the last correct digit preceding the 
next burst. A gap of length m Is defined to be a sequence 
of m consecutive error free digits between two successive 
errors. A gap may occur within a burst or actually be the 
burst Interval. 

It Is apparent that the sequence of received digits may 
be completely punctuated by the errors Into bursts and burst 
Intervals, however this partitioning Is not unique. The 
burst length and burst Interval distributions are statistics 
of the channel and must either be known or at least a 
reasonable statistical estimate should be available. Since 
the partitioning Is not unique, the burst and burst Interval 
should not be used to characterize the channel. To avoid 
this difficulty, we return to the gap distribution. VJhlle 
the gap distribution will affect the burst length. It Is 
not subject to Interpretation ambiguities and may be used 
to uniquely determine a possible channel model. 

There are two primary methods of characterizing the HP 
channel. The first consists of actually recording error 
patterns and statistics for a reasonably extensive period 
of time and assuming these are representative of the channel. 
The data may then be utilized to determine the effectiveness 
of various coding schem.es by actual simulation or the 
performance estimated by the coding parameters. The second 
approach Is to use, again, measured parameters to Infer a 
stationary homogenous Markov chain model which may then be 
utilized to characterize the channel. The usefulness of 



this method follows from the properties of the stationary, 
homogeneous Markov chain, since the chain Is completely 
characterized by the matrix of one step probability transi- 
tions. This approach Is presented in detail by Pritchman 
[13] j Tsai [5] j and McManamon [6] , together with results 
which are In very good agreement with measured data. The 
aperiodic Markov chain model, as described by McManamon, is 
completely determined by the gap distribution. Since a gap 
of length n Is, by definition, a sequence of n consecutive 
error free digits which are immediately preceded and followed 
by errors, the probability of a gap of length n, f(n) may be 
Interpreted as the return to an error state in exactly n+1 
steps. Therefore, f(n) is simply the first return probabil- 
ity distribution of the Markov chain. The mean return time 
may then be expressed as 

oo 

y = E nf(n) 
n=l 

The stationary distribution of the Markov chain Is of con- 
siderable practical importance. Denoting the probability 
that the output of the channel at time j Is in error by P(j)j 
we may then ask 'How does P(j) behave as time progresses?' 

The answer is given by the Ergodlc Theorem for Markov chains 
(Cox and Miller [l4]), where the stationary distribution is 
defined in terms of the mean return time. The standard 
definition for the first return in the Markov chain includes 
the return state. Therefore, in terms of the gap distribu- 
tion f (n) , as defined above. 



Llm P(j) = = 6 

j ->00 

where 6 Is the average bit error probability. This simply 
states that after a long period of time the average prob- 
ability of the output being in error Is Independent of the 
initial distribution and Is equal to the Inverse of the 
average gap distribution. 

In summary, the HP channel is neither the classical 
random error channel nor the typical burst channel, but 
rather a hybrid channel which may contain may contain many 
long bursts between which occur random errors. For the 
convenience of the reader, the measured burst and burst 
Interval distributions given by Tsai [ 5 ] are reproduced 
here as Figures 2.11 and 2,12 respectively. 

Figure 2.11 may be used to obtain the burst duration, 
for example 80 percent of the bursts are less than 20 bits 
in duration. Figure 2.12 gives the Interval between bursts, 
and by a similar examination it can be seen that 40 percent 
of the burst Intervals were less than 1200 bits. 
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Figure 2.11. "Burst distribution for an HF channeL" 
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Ill, CODING 



A. INTRODUCTION 

In the preceding chapter the effect of the channel on 
the transmitted Information was described. It should be 
noted that the modulation/detection procedure assumed Is 
non-coherent frequency-shlft-keylng . This assumption v:as 
made since It Is In wide use and of considerable practical 
Importance . 

Before we discuss specific coding procedures let us first 
review, In a very basic manner, what we want to do, and what 
Is available. A discrete, or digital communication system 
In which the performance may be described by error rates and 
probabilities Is assumed. The first question that comes to 
mind Is "Is there some 'source' which we could utilize In 
the channel to obtain the maximum rate, R, of communication 
with the smallest error rate?". The ansv;er is yes; for a 
significant class of channels. Shannon has shown that a non- 
zero capacity, C, exists such that 

C = max R 
[source] 

with an arbitrarily low error rate. In general It is not 
possible to engineer a system to the point where R = C, and 
the probability of an error Is extremely small. V/e choose 
to modify the question and ask "For some rate R (< C), can 
we significantly reduce the probability of an error?". In 
other words we are not really trying to solve the 













\ 
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"optimum" problem but rather a problem of what is 
reasonable . 

If we assume for the moment that we have a return 
channel, we have available simple error detection tech- 
niques, such as ARQ (Automatic Repeat Request) and the 
parity check schemes. The ARQ systems, introduced by 
Van Durren, are frequently referred to as 3-out-of-7, or 
"constant ratio codes," where the encoded messages consist 
of seven bits in which three 'ones’ and four 'zeros' are 
required to form a valid code word. Any single error, 
and errors of odd multiplicity (3,5, and 7), will be 
detected while only half of the even errors will be 
detected. The remaining even errors will then constitute 
'real' errors at the output. 

In the parity check system a sequence of n-1 inform.atlon 
carrying digits are appended by a single digit, known as the 
parity check digit, so that the total number of ones in the 
n sequence is even. Again at the receiver, the parity is 
checked and if this check fails, an error has been detected. 
It is again apparent that this scheme will detect all errors 
of odd multiplicity. The efficiency is much higher being 

however, the rate again suffers by the retransmission. 

Another alternative, which is more attractive, is a 
system where error correction is possible. In general, the 
error correcting code which will correct 't' errors, con- 
sists of a mapping of k Information digits into n channel 
digits in such a fashion that at least 2t + 1 channel errors 



will be required to change any valid transmitted word into 
another valid word. The decoding may be done in many ways. 
One, becoming more promising as the state of the art 
develops, is by a table look-up from a read-only -memory . 

In this procedure the received word is compared with the 
valid code words and the one which differs in the fewest 
positions is then chosen as the most likely one to have 
been sent , 

In the above paragraphs we tacitly assumed that any set 
of n channel digits were determined by a unique set of k 
information digits, and conversely one set of k information 
digits uniquely determined one set of n channel digits; 
this corresponds to block coding. Another form of coding 
permits any set of k information digits to affect several 
blocks of channel digits, and conversely any block of channel 
digits will be affected by several blocks of information 
digits; this corresponds to convolutional (or recurrent) 
coding. 

If the 1^ sequence of n channel digits contains the 
corresponding 1^^ sequence of information bits explicitly , 
the code is said to be systematic. Systematic codes may 
have a marked advantage over non-systematlc codes in that 
they may, of course, be decoded with error correction by 
those with the decoding equipment, while those v/lth only a 
limited amount of equipment may, with proper synchronization, 
simply regenerate the code from the appropriate information 
digits and use the result for error detection alone , relying 



on a retransmission to correct the indicated errors. Those 



who have little equipment m.ay , for the price of timing, 
have access to the information digits alone. 

In summarizing the above procedures, we must again look 
at the channel. If the operational requirements are such 
that a two way, or return circuit is not possible (for 
example in a fleet broadcast network) the error correction 
capability is highly desired. 

B . CONVOLUTIONAL CODES 

Let us begin by describing a few items which are very 
basic to the discussion which follows. The term encoding 
is used to imply a transformation or mapping from the set 
of information sequences into another set of channel 
sequences, as Illustrated in Figure 3.1. The code is the 
image of the transformation. 




Figure 3.1. Mapping provided by code. 
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We restrict our attention to binary codes, where the ele- 
ments of the Information and channel sequences are either 
0, or 1. If each Input sub-block contains a digits, while 
the corresponding channel sub-block contains y digits, the 

OL 

code Is said to be a rate — code and designated as a 

Y 

"(Y,cc) code." Since we are dealing with binary codes, the 
addition we will use Is Modulo 2, where 

0 + 0 = l + l= 0 

and 



l + 0 = 0 + l= l 



A convolutional code Is said to have memory span v. If 
each encoded digit Is a linear combination of Information 
digits In the present set, and at most v - 1 of the preced- 
ing sets of Information digits. It should be noted In 
passing, that If v = 1, the code corresponds to a block code. 

Another parameter, which Is closely related to the 
memory span. Is the actual constraint length (M) , which Is 
defined for a convolutional code of memory span v, as 
N = vy . This constraint length plays a role In convolutional 
codes similar to the block length In block codes. 

t h 

For Convolutional codes, we define t. . as the j digit 

1 3 J 

J_ I- 

of the 1^ set of channel digits. In terms of message digits 
mj^(l), as 



t . 

1 






v-1 a 
S E 
q=0 n=l 






(n)mi_q(n) 



1 < j < Y (22) 

(Modulo 2) 



set of Infor- 



where digit of the (i-q)^^ 

mation digits, and g .(n) is either 0 , or 1 depending on 

Q 3 J 

1“ y-v 

whether or not m. _ (n) is to be included in the j trans-. 

_L 

mitted digit. From equation 22, we can see that any partic- 
ular message digit can affect at most v sets of y transmitted 
digits, which prom.pts the definition of memory span. 

Turning our attention to the elements g .(n), the 

Q 3 J 

choice of values for these elements will clearly determine 
the properties of the code. If we define g .(n)as: 



In -(n) = 

J ,n 


1 < j < a 


: . (n ) = 0 

Q3J 
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V| 

V| 
1 — I 



where 6. , is zero if j k , and 1 if j = k. The first a 

J 3^ 

t h 

digits of the i^ set of channel digits will then be 

t h 

identical with the a digits of the 1^ set of information 
digits, in which case the code is said to be systematic 
(or canonic systematic). In most of the following we will 
treat systematic codes only, since Massey [15] has shown 
that any non-systematic code can be converted to an equiv- 
alent systematic code without affecting the error correcting 
capability of the code. In general the constraint length of 
the non-systematic code will be shorter than that for the 
equivalent systematic code. 

At this point a short example might help to further 
explain the procedures. 

Example 1 . A Systematic ( 33 I) convolutional code with 
memory span 5. From equation 22 v;e have 



(El-1) 



v-1 a 

q 



i 1 " ^ 2 g .(n)m (n). 

q = 0 n=l ^ ^ 



Since the desired code has a = 1, we let m._ (1) = m._ , and 

1 q a q 

g .(n) = g . , we may rewrite equation El-1 as 

q > J q > J 

v-1 

t • • — S g • m • • 

q=0 

Now, since the memory span v = 5 j we have v - 1 = 4 and: 

Sl,j^l-1 ^2,j^l-2 ^3,J^i-3 

Since the code is systematic, we know 

8o.l ■ eq.l = 

Let us choose, somewhat arbitrarily. 



,2 ® 1,2 ^ 4,2 ® 2,2 ^ 3,2 ° 



(El-2) 



and 



®0,3 ®2,3 ®1,3 ®3,3 ®4,3 ° 



The code now may be written as 



t • rn • 

1,1 1 



t. ^ = m. + m. + m. 
1,2 1 1-1 1 -^ 



t . ^ = m . + m . ^ 
1,3 1 1-2 



For this code the actual constraint length is N = = 3x5 = 15. 

A different method of visualizing this encoding procedure 
was developed by VJyner and Ash [l6] , and consists in consider- 
ing g_ ,(l),..,,g .(a) to be a row vector as 

4 ^ J M > J 



c: c 



t h 

and a column vector of the (i-q)^ set of information 

digits such that 

^1-q ’^i-q^°‘^^ • 



Then 






v-1 
. = E G 



q=0 



,M. 

q,j i-q 



t h 

If we now let be the column vector of the i^ set of 
transmitted digits , we have 



T. = 
1 



t . , 

1,1 

t . - 

. 1,2 



i,Y 



^ v - 1,1 * * • ^ 1,1 ^ 0,1 

® v - l ,2 • • • ^ 1,2 ^ 0,2 



G ^ • • • G ^ G p. 

V-1,Y 1,Y 0,Y 



M 



i-v + 1 



M 



l-v+2 



M 



By dealing only with systematic codes we may greatly simp- 
lify the matrix, since g„ .(n) = 6. and g !.(n) = 0 for 

Q>J 

q 7 ^ 0 for j between 1 and a. 



o 

1 


O 


. . . 


1 

1 

o 

j 


^v-1 


^v-2 1 




^1 



I I 

H — 

I G 



0 



^i-v+l 

^i-v-f-2 



M, 



Where I is the (axa) identity matrix, 0 is the (a, a) null 



matrix and G. is the (y-a) x a matrix defined as 
J 



G . — 
j 



,a+l 








■■■ 


,a+2 

• 





,a+2^^^ 

• 


Sj ,a+2^^^ 


... 


• 








... gj^^Co.) 



( 2 ^ 1 ) 



If the number of input message sequences is indefinitely 
long, we may consider the transmitted channel digits to form 
a semi-infinite column vector T. Where T 



T = 



^1 




I 


0 


0 


















Ml 








<() 


<l) 


















M2 


■^2 




0 


I 


0 


















M3 


cL 




«1 


^0 


4 ) 


















Mu 


• 

• 




• 

• 

• 


• 

• 

• 




















• 


T n 




0 


0 


0 

• • • 


0 


I 


0 


0 


0 


0 


0 




• 


V — 1 




*^v-2 


°v -3 




^1 




<P 


<p 


<p 


<p 


<P 






T 




0 


0 


0 


0 


0 


I 


0 


0 


0 


0 




*^-l 


V 




^-1 


®v-2 


^v -3 


^2 


®1 


^0 


4 > 


4 > 


4 > 


4 > 




M 






0 


0 


0 


0 


0 


0 


I 


0 


0 


0 




” 


^v+l 




4 > 


G T 
v-1 


^-2 


"3 


®2 


®1 


^0 


<p 


<t> 


4 > 




M 

+ 1 


T 




0 


0 


0 


0 


0 


0 


0 


I 


0 


0 




M 

“+2 


v+2 






<() 


G 

v-1 


Gi, 


G3 


G2 


«1 


^0 


<P 


<P 




• 


• 

• 








• 


















• 


• 








• 





















— 

G„ 
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and <() is a (Y-a)xanull matrix. For convenience we will 
refer to the semi-infinite matrix which multiplies the 
column vector of message digits as G^, while the matrix 



which generates only the set of channel digits may be 

defined from equation 23 as 



0 1 


0 


ft* 


1 0 1 


I 




1 ^ o 


• f « 


1 1 


G 


v-l 1 


v-2 




' 1 ' 


0 



( 26 ) 



Although has an infinite number of rows and columns, any 
particular row will have at most av non-zero elements and, 
correspondingly, any particular column will have at most 
N = Y'^ non-zero elements. 

Returning to example 1, from equation 23 we may v;rlte 
the 1^^ transmitted sequence as 



T. = 
1 



0 0 0 0 1 
10 0 11 
0 0 10 1 



"^ 1-4 



m 



i-3 



m 



1-2 



">i-i 



m, 

1 



and by inspection, equations 25 and 26 yield 



G 



0 0 0 0 1 
10 0 11 
0 0 10 1 
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% 







G 



oo 



100000000 . 
100000000 . 

100000000 . 

010000000 . 

110000000 . 

010000000 . 

001000000 . 

011000000 . 

011000000 . 

101000000 . 

000100000 . 

001100000 . 

010100000 . 

000010000 . 

100110000 . 

001010000 . 

000001000 . 

010011000 . 

000101000 . 

000000100 . 

001001100 . 

000010100 . 



The physical generation of this code Is straight forward 
involving unit delay elements (shift registers) and modulo 
2 adders (exclusive 'OR’ gates), as shown in Figure 3.2. 
The rectangular boxes represent unit delay elements, while 
the circles with the cross represent the modulo 2 adders. 




Figure 3.2. 



Encoder for Rate 



1 

3 



convolutional 



code 
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Returning to the general problem, when the channel 
digits are transmitted through the channel, noise may 
corrupt some of them, causing the received digits to differ 
from the original transmitted digits. Utilizing matrix 
notation, the i^^ received sequence may be expressed as: 



R. = 
1 



^ 1,2 



r . 

1, 



^1,2 



t . 



e . T 

1,1 



i,2 



e . 

1, 



= Ti + El 



(27) 



Where e. . is 1 if an error has occurred in the position 

1 3 J 

of the i^^ transmitted sequence and zero otherwise. Our 
task may simply be stated as determining which element of 
are most likely to be non-zero. 

Since we are dealing with systematic codes, we have 
available estimates of the 1^ set of information digits, 
namely ml . = r. .. By utilizing the i^^ v - 1 preceding 

i 3 J ^ 3 J 

sets, we may regenerate the code with a duplicate encoder 
and obtain an estimate of the transmitted parity digits as: 



t' . = E Eg .(k)r ^ a +1 < J < Y 

q=0 k=l 



By adding t! . to r. . (a+1 £ j £ y) we obtain what is 

1 3 J 1 3 J 



called the syndrome s. .. 

1 3 J 



s . . = t ! . + r . . 

ijJ ijJ ijJ 



v-1 a 

q= 



i. .= E E g .(k)(m. ,+e. ,) 

ijO q=0 k=l i~Qjk 1 — Qjk 



since 



v-1 a 

+ E Eg. (k)m. , + e . . 

q=0 k=l "J-J 



V-1 a 

t. .= E E g .(k)m. , 

l.J q=0 k=l '>>■3 ^-‘1"'" 



Since the encoder is linear we may further reduce this 
syndrome to 



v-1 a 

s. . = E Eg ,(k)(m. , + m. , ) 

I3J q=Q q>J i-q,k i-q,k" 

v-1 a 

+ E E g .(k)e. ,+e. . 

q=0 k=l <1>J 



however, m. , +-m. , = 0 Mod 2. 

i-q,k i-q,k 



Therefore 



s . 

1 






v-1 

E 



a 



(k)e. ,+e. . 

q = 0 k=l 



for a + 1 £ j £ Y 

( 28 ) 



For each set of Y received digits we will be able to form 
Y - ot syndromes, which depend only on the errors in the 
received sequence. 

Again let us consider the matrix notation and form a 
column matrix of syndromes. Prom equation 28 we may form 
as 









(29) 






S4 

i ,a+l 

^i,a+2 

S * _i_ o 

1 ,a+3 



%-l ° S-2 0 



0 G. 



0 G, 



I 



®l-v+l 

^i-v+2 




E. 

1 



Where 0 is a(Y-a)x(y-a) null matrix, G. is defined in equa- 

J 

tlon 24, and 1 is an (Y-ot)x(y-a) identity matrix. Vie are 
now able to write the entire set of syndromes, S, in a 
fashion similar to equation' 25. 



Y columns 




S = A E . 

00 

C. THRESHOLD DECODING 

V/lth these syndromes available, we turn our attention to 
a form of decoding originally introduced by Massey [151 
called Threshold Decoding, in which the error decoding 
decision is based on the value of the majority of the 
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syndromes corresponding to those which would be ’1’ if 

e. . were actually in error. Prom equation 30 we see the 

. .th 

first set of syndromes affected by (i.e. the 1 set 
of error digits) is . Since the memory span is v, we 
know the effects of errors in will have to be confined 
to the syndromes ^i ^1+v-l’ 



^i+1 

^ 1+2 



i+v-1 



v-1 



E. 

1 



Where as before is a (y-a)xa matrix whose elements are 
either 0 or 1, i.e. the j column of is 

gk,a+2(<^’^ 

Skja+S^'^' ^ 



Sk,Y 

Thus those syndromes, which will be affected by the error 
in the position of the error sequence E^ will be those 

syndromes for which g^ (ot+1 5.^— — 

In other words, if e, . = 1 and no other errors occur, only 
those syndromes which have ^ will be non-zero. 

The presence of other errors within the sets of v - 1 error 
sequence either prior to, or after E. may alter some of 



these syndromes to negate the effect of the error. The 
decoding proceeds by examining those syndromes which cor- 
responds to e. . and a ’majority vote' decides on the value 

^ 3 J 

of e. l.e., if more than half of the syndromes are 1 
1 ^ J 

the decision is that e. . = 1 and the corresponding infor- 

^ 3 J 

matlon digit is changed. If the digit is corrected the 
effect of the error may be removed from the set of syndromes 
by inverting all of those syndromes used in the calculation. 

This mode of operation is referred to as feedback 
decoding, and as long as no decoding error is made, the 
decoder operation is superior to decoding without feedback 
(normally called definite decoding). On the other hand, 
when a decoding error is made, the eroneous correction 
tends to propagate. This error propagation is one of the 
acknowledged difficulties of convolutional codes. To avoid 
error propagation we Introduce the concept of a self- 
orthogonal (or canonic self-orthogonal) code due to Robinson 
and Bernstein [ 17 ] . A self-orthogonal code is a convolu- 
tional code in which any two syndromes which check e. . have 

^ 3 J 

at most one error digit in common. Since all the syndromes 

which check e. . have e. .in common, the definition requires 
1 j J ^ j J 

any other error digit to be Included in at most one syndrom.e . 
Robinson [l8] has shown that a self-orthogonal code has 
limited error propagation, and on the other hand, may be 
decoded without feedback with no error propagation with only 
a slight loss in error correction capability. 



To Illustrate the threshold decoding procedures, recall 



example 1, where 



T. 

1 



0 0 
1 0 
0 0 



0 

0 

1 



0 1 
1 1 
0 1 



m 



m 



1-3 

i-2 



"’i-l 

m. 

1 



By comparison v;ith equation 26 v;e have 



'l‘ 

_1_ 


: = 


'l' 

_0_ 


; - 


0 

_1_ 


j G 2 


'o 

A 


; G^i - 


~i 

_o_ 



As in equation 11 the syndromes vjhich check the i^^ digit 
may be seen from: 



s. „ 




110 




1,2 








s. ^ 




10 1 




1,3 








~ — 


3 




10 0 




e , n 


1+1,2 








i,l 


S. , , ^ 




0 0 0 






1+1,3 










^i+2,2 


_ - 


0 0 0 




^i,2 


^i+2,3 




10 0 






^i+3,2 




0 0 0 




i®l,3 


S , 




0 0 0 




— 


i+3,3 








^i+iJ,2 




10 0 




^l+il,3 




0 0 0 





and we see e. will effect the syndromes s. s. 

®i+l 2’ ®i+2 3’ ^i + il 2‘ five syndromes, the major 

ity rule decides e^ ^ = 1 if and only if three or m*ore of 
these syndromes are 1* If this set of five syndromes is 
expressed in terms of the error digits, it can be seen 
that the only digit in common betvreen any two is e. , 

_L . -L 



henc 



this code is self-orthogonal. The decoder is illustrated 
in Figure 3-3 where as before, the rectangular boxes are 
delay elements and the circles are modulo 2 adders. 

Returning to the general concept of threshold decoding, 
it should be pointed out that the encoder and decoder are 
relatively simple to Implement. To obtain the maximum 
benefit from threshold decoding, the code should be self- 
orthogonal. Robinson and Bernstein [17] have developed a 
synthesis procedure, utilizing finite difference sets 
whereby these self-orthogonal codes may be constructed. 

Confining our attention to systematic codes of rate one 
'half, the transmitted digits assume the form 



t . .. m . .| 

1,1 1,1 



v-1 

t . ^ = 2 g, m. , 

1.2 k=o '' 



or. In matrix notation 



T.‘ 

1 



0 0 
Sv-1 ®v-2 




After the digits have been transmitted and received, we may 
again form the syndromes, realizing for this case we v/lll 
have only one syndrome for each set of transmitted digits. 
Forming the l^'^ syndrome by analogy with equation 29 
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6 ? 



Figure 3.3. Decoder for rate — convolutional code 










g T 0 g ^0 

°v-l v-2 



gl 0 go 1 



^l-v+1,1 

®i-v+l,2 



1 - 1,1 

® 1 - 1,2 

" 1,1 

"l,2 



We note that only the Information error digits are Included 
t h 

In the 1 syndrome calculation except for the parity error 
digit e^^ 2 , hence for convenience we will isolate the 
information and parity error digits and write instead 

A 





"i 




s -p 

Vl V2 • • • ®1 ° ° ° 




®i-v + l,l 




®l-v+l,2 




®i+l 




0 . g2 g;L ®0 ° ° 




^l-v+2,1 




®i-v+2 ,2 


s.= 












+ 




1 


• 




• 




• 




• 




®l+v-l 




0 0 ... ^1^-2 • • • ^0 




®l+v-l,l 




• 

®l+v-l,2 



Where is a column matrix of the syndromes s , . . . 

From thb definition of memory span, the 1^^ message digit 

can only affect these syndromes. Examining the column 

of the matrix, it is obvious that e. , will affect only 

1 3 1 

those syndromes for which g. =1. 

For threshold decoding we examine only those syndromes 

for which the column of A contains g. = 1, and form a 

J 

reduced set of syndromes 
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Sv-1 «v-2 • • • 8i So 0 0 0 



^i-v+1 , 1 



®i-v+l,2 



"Ri = 



'v-1 ' * * ^i+v-1,1 ^l+v-1,2 



By stipulating the code to be self-orthogonal, we are assured 
that no column (other than the will contain more than 

one element . 

If there are a total -of L syndromes which check e^ 

then the majority logic decides e. -. = 1, If and only if the 

number of non-zero syndromes Is greater than + 1, where 

Is the integer part of A relatively straight forward 

calculation shows there are ^(L-1) previously decoded error 

positions, ^(L-1) error positions which have not yet been 

decoded, L parity error positions, and e. , , which will 

2 

effect the decoding, for a total of L +1 possible positions 
for errors to occur. If definite decoding (i.e. no feedback 
correction to the syndromes) is used, we may calculate the 
probability of making a decoding error for the binary 
symmetric channel (where the probability of making an error 
is 3 Independent of the original value of the transmitted 
digit) . 

The probability of correctly decoding e. is simply the 

probability that or fewer errors occur in the possible 

2 

(L - 1) positions, hence 



(correct decoding) 



= E 
1=0 






r n 



Now 



1=0 ^ 



L^ + 1 



= 1 - Z 



l=[|t+l 






and the probability that a bit is decoded in error is P 



DD 



DD 



= 1 - P 



L^+1 
= Z 



(correct decoding) 



L^+l' 



i=[^Hl 



6^(l-6) 



L^+1-1 



If B is reasonably small this may be approximated by the 
first term as 



P 



DD 



^L^+1 

[|-t+lj 



[^1 + 1 

6 



( 1 - 6 ) 



L^+1 




( 33 ) 



The decoding error probability for feedback decoding, 
on the other hand, is more difficult to analyze. The bit 
under consideration will be decoded correctly if 1 previous- 
ly decoded bits were in error, provided that fewer than 
- i errors occur in the bits which have not yet been 
decoded and the L syndrome error positions. Hence the 
probability that a bit is decoded correctly is 



(ft 



(correct decoding) 



- i 



y P L 

(undecoded errors £ ^ 

decoding errors) decoding errors) 

O'!) 
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For the conditional probability there- are ^(L+1) total 
undecoded error positions, hence, assuming independent 
errors , 



(undecoded errors 



[^t-l/ L(L+D 



= Z 
j = 0 



2 




( 1 - 6 ) 



1 decoding errors 

L(L+1) 

2 ^ 



) 



/ 



( 35 ) 



Designating the probability of a decoding error as (for 

feedback decoding) and assuming again independent errors 
within the ^(L-1) previously decoded positions, 



P 



(1 



decoding errors) 



L(L-l) 
2 

i 




PpD 



)^ 



( 36 ) 



Therefore , 



(correct decoding) 



[|t [^t-l/ L(L+D \ 

E Z 
1=0 j =0 



L(L-l) 



B^ (1-B) 



- J 



' L(L-l) 
2 



L(L-l) 



P^ (1-P ) 

FD^ FD'^ 



- 1 



Noting that 1-P, ,, >, = P-pr,* this may be 

^ (correct decoding) FD’ 

reduced to 



1 = Z 
i=0 



[g-t-l/ L(L+D 
Z 

J = 0 



L(L+1) 



2 iB'^d-B) ^ 

j / 

L(L-l) 



- J 



fL(L-l) 



2 
i 



FD 






( 37 ) 



Although rather tedious, by hand, the solution may be 
obtained readily on a computer. Obvious approximations may 
be made, v;hen B is sufficiently small so that and. 

PpD Ppp 9- very reasonable approximation Is obtained by 

3 

assuming - 0, and solving the quadratic equation vjhich 

results . 

D. OTHER DECODING METHODS 
1. Sequential Decoding 

Another algorithm for decoding convolutional codes 

is sequential decoding, which was introduced by Wozencraft 

[19] > and differs from threshold decoding in that it is 

probabilistic in nature. The encoder for a (y ,a.) code is 

viewed as a directed graph or tree composed of nodes and 

cx 

branches. For a binary (y ,a) code, from each node 2 
branches emanate, and to each branch is assigned a sequence 
of y binary digits. The decoder has available or is able 
to calculate the channel probability characteristics, and 
a copy of the tree which the encoder is utilizing. When 
the first few sequences are received the decoder proceeds 
to hypothesize which sequences were 'most probably' sent 
and moves one node farther into the tree. This process 
continues until errors occur, at which time the decoder may 
get off onto the wrong branch. When this occurs it is 
forced to make additional errors, since the sequences on 
the incorrect path have no relation to the sequences 
actually transmitted. The decoder will eventually realize 



7P 



f 

j’ 



r 



i 

!, 






that something is wrong, at which time it back-tracks to a 
previously visited node and tries another branch. If none 
of these branches are better, it again has to back-track to 
yet another previous node and search the branches eminating 
from that node. All of these operations take time, in 
addition to the time required to calculate the channel prob- 
ability characteristics, when this must be done. If there 
is only a finite amount of buffer storage available for 
the Incoming data, a long search might not be completed 
before the storage registers are filled, in which case a 
buffer overflow occurs and the system must be resynchronized . 

Sequential decoding may be done on any convolutional 
code and, if the constraint length is very, very long, the 
decoder will eventually decode the transmitted sequences 
correctly with probability approaching 1. 

For illustration purposes consider a simple (3,1) 
systematic convolutional code of memory span 3. Figure 3-'^ 
is the tree graph of the desired code. 

At each node are two branches corresponding to the two 
possible values of the information digit (i.e. 0 or 1) , a 
'O' Implies the upper branch while a '!' implies the lower 
branch. This code was constructed by utilizing the proce- 
dures developed by Lin and Lyne [20] . 

The first input sub-block (in this case a single digit) 
determines which of two output sub-blocks v;lll be trans- 
mitted, i.e., 1 -> 111; 0 000. The second output sequence 

will depend on both the first and second input sequences. 



000 



0 

+ 

■I' 

1 



000 



111 



111 



001 



110 



r\r\ r\ 


000 


UU U 


111 


111 


001 


110 


001 


010 


101 


110 


oil 


100 


010 


000 


111 


101 


001 


11b 


oil 


010 


101 


100 


oil 


100 



Figure 3-^. Tree graph at 
convolutional code. 

If the first input was '1' and the second *0’, then the 
second output sequence would be 001. The third output 
sequence, in a like fashion, will depend on the first 
two inputs and the third input. The fourth output sequence 
is dependent on the fourth input and the preceding two 
Inputs - and so the process continues. As an. example the 
Imput sequence 10110 would be mapped into 111 001 100 110 
oil. The encoder for this code may be Implemented with 
unit delay elements and modulo 2 adders as indicated in 
Figure 3 . 5 . 

In the decoding procedure, the receiver examines three 
sets of sequences, then outputs the best estimate of the 
first digit. For example, assume the transmitted sequence 
were 111 001 101 111 corresponding to an input 1011, 
while the received sequences were 100 001 101 110 011. 



714 




Figure 3-5. Encoder for convolutional tree 
code shown In Figure 3.^ 



The decoder ’knows' that the first sequence was either 
111 or 000, between these two 000 is the more likely 
(assuming a memoryless binary symmetric channel where one 
error is m.ore likely than two). 

Therefore, the initial hypothesis is that the first 
digit of the transmitted sequence is 'O', the decoder then 
proceeds to the ne“xt node, again the two choices are 
000, and 111, of these 000 is again the most logical since 
only one error is required to transform 000 into 001. 

Going on to the third node the decoder chooses 111 again 
with one error. At this point the total number of errors 
required to transform the transmitted sequence into the 
received sequence is three. The decoder calculates at 
this point (as at the other nodes) the set of channel 
probability characteristics and decides that perhaps three 
errors in the nine digits is excessive in vjhlch case it 
looks at the other branches from the third node. The other 
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branch is quickly ruled out since four errors would be 
indicated. The decoder then goes back to the second node 
and looks at the other branch, where again the number of 
errors would be three, so the decoder continues back to 
the first node. Again the first node lower branch indi- 
cates two errors, however, the decoder goes along this 
path to the second node, where the upper branch has no 
indicated errors . Going farther into the tree to the 
third node there are again no additional errors hence, 
the decoder alters its initial hypothesis and assumes the 
first bit to be ’1’. Preceding into the fourth node there 
are no indicated errors within the constraint length, so 
the decoder hypothesis is the second digit is *0’. And 
so the process continues, backtracking when the number of 
of errors becomes excessive. 

2 . Viterbi Decoding Scheme 

Another method of decoding convolutional codes is 
the Viterbi algorithm [21] . Omura [22] has shown that this 
decoding scheme may be viewed as a forward dynamic program- 
ming solution to a generalized regulator problem. The state 

of the encoder at time k+1 is dependent on the state at 

t h 

time k and the k^ message input, hence one may write for 
the state at time k+1 



^k+1 



AX, + B M, 
k k 



The output of the encoder at time k is some function of the 
state of the encoder at time k, hence the output may be 



denoted as • Again transmitting the encoder 

output through the channel, the received sequence will be 

R = T + E, . Defining a performance measure J(T) as 
k Ic k 

L 

J(T) = 1 logP(R|T) = - Z logP(Rj^|T ) 

k=0 



the decoding proceeds by defining Intermediate costs as 






min 



L 

E logP(R. |T.) 
L-llj=k+l 



for each k = 0,1,..., L-1, and defining foCXj^) = 0. Since 
the decoder follows the path with the minimum cost an error 



will occur if and only if the minimum cost is Incurred on 
some path other than the correct path. 



E. APPLICATION OP CODING TO CHANNEL 

The maximum expected differential time delay of 5 msec 
for different propagation paths requires the signal to have 
a duration of about 10 msec, which in turn implies a maximum 
data rate of about 100 bits per second. For convenience, we 
shall assume that the data rate to be used is 75 bits per 
second, which corresponds to the standard 100 word per mlnuue 
teletype. In addition, we shall use a rate ^ code, and, 
since the encoder outputs two digits for each input digit, 
the modulation method will be frequency division multi- 
plexing the information digits onto one 75 bit per second 
subchannel and the parity digits onto another. A block 
diagram for the system is given in Figure 3.6. 




u 

Q) 

-P 

-P 

•H 

e 

W 

C 

cd 

Eh 

T 



>:> 0) 
OCX 
COO) 

(D tH I — I 
P CO Ph - 

CD > -P 
"H I — I 
pH Q P 





i t 


L 


P 






o 






•H 






pi 






Cd 


CO pi 


CO 


P 


P^ *H 


pi 


U 


•H p 


•H 


o 


CQ cd 


CQ 


Ph 


IP 




P 






M 







T=r^ 

cd 

P 

o P 



P> 

0 ) P o 

pi iH O 

cd o p 
p:: >W 
P 
o 
o 

_ — 



P 




O 




•H 


O 


pi 


0 0 


Cd 


O CO 


E 


p \ 


P 


P 


o 


O 


Ph 


CO i_n 


P 


tr— 


M 





p 

o 

•H 

pi pi 
Cd P 
P 

P pi 
O P 
Ph O 
P 
M 




Figure 3.6. Block diagram for Implementing a rate \ code 





The distributions given by Tsai [51 were obtained 
utilizing a channel data rate of 75 bits per second, and 
indicate that with probability 0.97, the bursts are less 
than 50 bits in duration. While it is not impossible to 
Implement a burst error correcting code to decode bursts 
of length 50, the burst correcting codes all require a 
minimum guard space of error free digits. This error free 
guard space is not generally found in the HF channel. 

Since burst correcting codes are not desirable, the 
alternative is to modify the distribution of the bursts. 
This burst modification may be performed by a process 
known as interleaving. Interleaving is simply a time 
ordering of the transmitted digits so that adjacent errors 
in the channel are spread out in the received sequence 
prior to decoding. (Some forms of interleaving may be 
viewed as time multiplexing.) Interleaving by k bits may 
be accomplished by many methods, however, one of the 
simplest is to replace each delay element in both the 
encoder and decoder by a k bit shift register. This has 
the effect of inserting k columns of zeros between the 
columns in the generator matrix, G^, of the code, and 
correspondingly k rows of zeros between each of the rows 
in the syndrome matrix, A^. Any burst of errors that is k 
digits or shorter in length will not affect more than one 
of the digits in each of k succeeding decoding steps. On 
the other hand, there may be errors from more than one 
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burst included in the decoding calculation. The inter- 
leaving cannot alter the average bit error probability, 
all it does is rearrange the errors so they occur in a 
more evenly distributed fashion. For the data presented 
by Tsai, interleaving by 50 bits would then insure that 
fewer than two error digits from a particular burst would 
be contained in the digits utilized for any decoding 
operation with probability 0.97. 

The amount of interleaving required is dependent on 
the duration and frequency of the bursts, and the constraint 
length and correction capabilities of the code being used. 

As the amount of interleaving is Increased the channel will 
appear more and more random, however, it must be noted that 
the interleaved data will be extremely susceptible to 
periodic interference unless care is used in choosing the 
interleaving. (For example 6 ^ bit interleaving v/ould not 
be desirable for use with a modulator utilizing 32 sub- 
channels, since occasional modulator synchronization errors 
would be related to the Interleaving. This would have a 
much more serious effect on the proper decoding than if the 
interleaving were chosen to be 63 or 65 bits.) 

When attempting to ascertain the degree of Interleaving 
required, actual channel characteristics or measured error 
patterns are utilized. For a given set of received digits, 
varying amounts of interleaving may be tried to determine 
when the errors are "random enough." To determine v/hat 
"random enough" implies, consider a set of data for which 



the average bit error probability is B . If the constraint 

length of the code is N and the code is Interleaved by I 

bits, then the effective constraint length will be N*I, and 

the decoding will be performed by examining this effective 

constraint length. Although the total number of errors is 

still the same, the ratio of the number of errors per block 

approaches 6 , since, by the law of large numbers, the 

probability of having more than 6 NI errors in NI digits 

approaches zero as NI Increases indefinitely. In general 

this would imply an excessively large amount of interleaving, 

since the trend may be rather slow. 

Another criterion is available to determine a reasonable 

estimate for the amount of interleaving. For any given 

code, the ratio of the number of errors correctable to the 

number of possible error positions may be obtained. For 

the definite decoding procedure of the preceding section 

[ft 

this is ' p ■ . The decoder will function properly (or at 

L +1 

least with some Improvement) until the ratio of the number 
of errors to the number of possible error positions reaches 



[|t 

— 5 — . Hence to determine a practical interleaving degree, 

L +1 

choose I so that the ratio of the number of blocks of 

[|t- 

length NI with more than — 5 — NI errors, to the total number 

L^+1 

of blocks is approximately equal to the probability of a 
decoding error for a completely random channel with 
the error probability 3. For convenience \'ie will use the 
definite decoding error probability Ppp- 



The term 



approximately above is used loosely since the effectiveness 
of the Interleaving is extremely sensitive to the actual 
bursts received. 

To Illustrate the procedure, consider a particular code 
capable of correcting two errors, with constraint length l8 
as given by : 





^1,1 




000000001 


II 

•H 


^1,2 




100010110 



Interleaving by I bits will simply insert I columns of zeros 
between each of the columns of the generator matrix above, 
and replace by m^ The reduced set of syndromes on 

which the threshold decoding is based are: 




^(i+I) 


- 


^(1+21) 


= 


^(l+4l) 




^(i+8l) 





100010110000000 

010001011000000 

000100010110000 

000000010001011 




(i+ll) 

( 1 + 21 ) 

( 1 +^ 1 ) 

( 1 + 81 ) 



,2 

,2 

,2 

,2 



Again I rows of zeros are to be inserted between each of the 
rows of the multiplying matrix above. For this code there 
are a total of 17 possible error positions within which 2 
errors may be corrected hence the ratio of correctable errors 
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to total error positions Is yj. From equation 33, the de- 
coding error probability, may be approximated as 



( 3 j ^ 
= 6803^ . 



) 



We now turn our attention to the actual error data, as 

contained in reference 23. We will consider three typical 

cases of measured error statistics where the average error 

_2 

rate 3 is about 2.5x10 . This implies that is about 

5x10 . Interleaving by I = 27 bits results in the number 
of blocks with more than (l8)(27) equal to 95 out of a 
total of 63675 blocks for a ’residual’ uncorrectable error 
rate of 1.5x10 . Interleaving by 5^ bits lowers this to 

about 1.2x10 , while interleaving by 10^ bits only brings 

it down to 7.86x10~^. Continuing to increase the inter- 
leaving to the point where I = 855 only changes the residual 
error rate to 5.9x10 . This is presented in tabulation 

form relative to NI in Table III. Again it should be 
mentioned that the effectiveness of the interleaving is 
strongly dependent on the actual characteristics of the 
bursts. (This information is not available for the data 
presented.) It appears as though a conservative amount of 
interleaving would be 5^ bits for the code under considera- 
tion, since for this value, the code would correct many of 
the channel errors, and still be reasonably practical. 
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Although the code presented here is not a very powerful 
one, as compared with some of the block codes or longer 
convolutional codes, the ratio of correctable errors to 
total possible errors is nearly as good as the Golay block 
code - which is capable of correcting 3 errors - (yj as 
compared with ^) • In addition, the simple syndrome 
decoding procedure is flexible enough so that by monitoring 
the syndrome register, the mode of decoding (definite, or 
feedback) could be determined - choosing feedback decoding 
during periods when there are relatively few errors indi- 
cated in the syndrome register and switching to definite 
decoding when the number of indicated errors could imply 
possible error propagation. This would give a higher out- 
put error probability during definite decoding, however 
there would be no error propagation. 

For the feedback decoding, and reasonably small B, 



is at least as small as P-inj assume P 



pjj -Qp: 

Prom equation 35 

P(channel errors < 2] 0 decoding errors)==l- 



FD 



0 . 



11 

3 



P( channel errors^l|l decoding error) 1 - 



11 

2 



6 ^ = 1 - 1656 ^ 
B^(1-B)^ = 1-55B^+99B^ 



P(channel errors=0|2 decoding error )( 1-B ) ^^=1-1B+55B^-165B 



and from equation 36; 

6 2 

P(0 decoding errors) = (l-Pp^) = 1 - 6Pp^ + 15Ppp 

P(1 decoding error) = 6Ppp(l-Ppp)^ = 6Pp^^ - 30Ppj^ 

2 

P(2 decoding errors) = 15Ppp 



8 ^ 



Substituting these expressions into equation 38 and solving 
the resulting quadratic equation yields 



■PD 



1 + 3306 ^- 158 ^ 6 ^ 

30(-116+1656^-5186- 



L ^ A _ 2 1656^-(116+1656^+5186^)3' 
\ ^ ( 1 + 3306 ^- 15846 ")^ 



A 



By expanding the square root and retaining only the first 



4 2 

two terms (since the third term Involves ((6 ) )>Ppp becomes 



1+3306^-15846^ 



\ 30(-116+1656^-5186^-) 



1 ±1 - 



1656^x30 (-11 6+1656^+5186^^ 
( 1 + 3306 ^- 15846 ^)^ 



The minus sign is to be used, since the positive sign results 
in a probability greater than 1 for small values of 6; and 
Ppp may be simplified to 

n ~ 165 6 A 



FD 



1+330^ 



A comparison of the decoding error probabilities is given 
in Table II. 



TABLE II 



6 


p 

^DD 


p 

^PD 


C\J 

1 

0 

1 — 1 


6 . 80 x 10 “^ 


1 . 65 x 10 ”^ 


10 ^ 


6 . SOxlO""^ 


1 . 65 x 10 “'^ 


10 “^ 


6 . 80 x 10 “^° 


1 . 65 x 10 “^° 



It must be noted that these calculations are for a com 
pletely random channel, however by Interleaving by 54 or 



more bits they should be within an order of magnitude of 
the observed statistics, again depending to a large extent 
on the actual distribution of errors. 



The discussion of effectiveness of coding must include 
some mention of block coding performance. One of the better 
block codes is the modified Golay [2^, 12] code, which will 
correct 3 errors within any 2H bit code word. For reasonably 
small 6 the probability of a decoding error is approx- 

imately given as 




1=;K 

10626B^ 



The error probability Pqqj Is not a bit error probability, 
but the probability for a 24 bit word, or equivalently a 
12 bit information word. To be comparable with the bit 
error probability obtained for the convolutional code, this 
word error probability must be converted to a bit error 
probability [Ref. 231. For the degrees of interleaving 
utilized for the convolutional code these bit error prob- 
abilities are listed in Table III. 

As can be seen from Table III, the codes are essentially 
comparable with the Golay code being slightly superior in 
performance, while the convolutional code may be simpler to 
Implement in hardware. 

The implementation of the code is straight forward, the 
encoder is shown in Figure 3.7 and the decoder in Figure 3.?* 



86 



-p 




ii C\j 



P 



(D 

"O 

O 

O 



cd 

C 

o 

•H 

P 

o 

> 

c 

o 

o 

<D 

P 

cd 

?H 

(D 

CO 

O 

P. 

o 

u 

a 

p 

o 

<p 

0 ) 

o 

o 

p 

w 



co 

<D 

P. 

;=5 

bO 

P 

P«H 



O »-7 







■4J 






Figure 3-8. Decoder for code generated by encoder of Figure 3-7 











TABLE III 



A COMPARISON OF BIT ERROR PROBABILITIES FOR 
CONVOLUTIONAL CODE AND MODIFIED GOLAY CODE, 
CHANNEL ERROR PROBABILITY, IS APPROXIMATELY 2x10 



NI 


Decoded Bit 
Error Probability 
Convolutional Code 


Decoded Bit 
Error Probability 
Modified Golay Code 


il80 


1.5x10"^ 


-4 

5.3x10 


960 


1.2x10"^ 


3.4x10“^ 


1920 


7.86x10“^ 


-4 

2.3x10 


15360 


-4 

5.9x10 


_4 

1.1x10 



In this case, each rectangular box represents a 5^ stage 
shift register. The mode selector examines the general 
state of the syndrome shift registers and if there are 
numerous indicated errors the mode is changed from feed- 
back decoding to definite decoding, the decoder remains 
in the definite decoding mode until such time as there are 
relatively few Indicated errors when the decoder is returned 
to the feedback mode. 

F. CONCLUSIONS 

The Improvement of the reliability of the HF communica- 
tion channel through the use of error correction coding has 
been the major concern of this thesis. The average bit 
error probability is determined by the number and duration 
of fades, and atmospheric noise. The fading is assumed to 
be an interference phenomena resulting from the existence 
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of multiple propagation paths, and lasting for periods of 
approximately one second. The atmospheric noise contributes 
random errors to the normally burst characteristics produced 
by the fades . 

It is demonstrated that simple convolutional codes 
utilized with moderate amounts of interleaving can obtain 
approximately an order of magnitude reduction in the output 
bit error probability. In addition, the relatively simple 
decoding scheme may be modified during reception to elimin- 
ate the possibility of error propagation, vjlth only a 
relatively minor loss in the error correction capability of 
the code. 

In order to fully utilize the channel other procedures 
should be followed, namely space diversity, where two or 
more separate receivers are utilized with antennas in 
physically different locations. This decreases the effect 
of fading resulting from the multipath conditions since 
the fading at different locations is generally uncorrelated. 
In addition, frequency diversity (v;hen possible) should be 
employed, since the fades are unrelated for carrier frequen- 
cies separated by more than 50 KHz. 

Since the normal allocated bandwidth in the HP spectrum 
is 3 KHz, many separate channels may be frequency division 
multiplexed onto the same carrier to achieve a higher data 
rate on the channel. Existing frequency division multiplex 
equipments have a 32 channel capability, with the sub- 
channels each operating at a 75 bit per second rate for a 
maximum data rate of 2400 bits per second. The error 
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correction coding will require a sacrifice in the data rate 
on the channel to provide a reduction in the output error 
rate. By using a rate \ code the information rate through • 
the channel will be reduced to 1200 bits per second, 16 
subchannels may then be used for the information bits and 
the remaining l6 subchannels for the parity bits. One 
method of implementing such a system indicated in Figure 
3.9. 

G. RECOMMENDATIONS FOR FUTURE RESEARCH 

There are three primary areas where considerable research 
could be applied: these are 1) the characterization of the 
HF channel, 2) the modeling of man-made noise and inter- 
ference, and 3) the decoding of convolutional codes. 

In the characterization of the HF channel the use of the 
Markov chain model is most promising, however, the principal 
source of difficulty is the non-availability of data. The 
data analyzed has been obtained from actual channel measure- 
ments which may have been perturbed by categroically diffrent 
propagation conditions. To avoid these interpretations, it 
is recommended that existing ionospheric channel simulators 
(24) be used to obtain characteristics which are dependent 
only on multipath phenomena. Actual channel data could then 
be compared with that from the simulator to determine other 
sources of perturbation. 

In the area of impulsive man-made noise or signal inter- 
ference maximum use could be made of the Hall model. The 
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Hall model was discussed in this thesis only for the ampli- 
tude characteristics of atmospheric noise. However, its 
pj’ij^cipgtl advantage lies in the fact that statistics such 
as pulse interval and pulse duration may be correctly 
obtained by proper specification of the covariance function 
of the modulating process, A(t), as described on page 28. 

This would be a valuable tool in the design of receivers 
for use in areas where unavoidable noise sources (such as 
powerline transients) cause excessive error rates with 
conventional receivers. 

One of the most important fields for additional research 
is in the area of decoding algorithms for convolutional codes. 
In general, there are some codes v;ith desirable distance 
parameters, but good general decoding algorithms are not 
available. Threshold decoding, while relatively easy to 
Implement, is not applicable to all codes. Sequential 
decoding, on the other hand, will work with any convolutional 
code, but it will not work well on channels where there is 
correlation between errors, i.e., burst channels. /.nile the 
Vlterbl decoding algorithm is a maximum likelihood decoding 
procedure, it is limited to codes of relatively short con- 
straint length by the storage requirem.ents . In short, there 
are no known classes of convolutional codes with decoding 
procedures comparable with the longer Bose-Chaudhuri- 
Hocquenghem block codes. 
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